Smart motion detection device and related determining method

ABSTRACT

A smart motion detection device with a determining method includes a memory, a processor, and a sensor array coupled to the memory and the processor. An image captured by the sensor array is processed by the processor. The sensor array is adapted to pre-store the image into the memory when the processor is operated in the sleep mode, and the pre-stored image is transmitted to the processor when the processor is operated in the wakeup mode. The sensor array includes a comparator adapted to generate an alarm signal for switching the processor from the sleep mode to the wakeup mode in accordance with a comparison result of the pre-stored image. The determining method includes the processor analyzing images captured by the sensor array when the sensor array is activated to capture the images, and the processor analyzing images pre-stored inside the memory when the sensor array is not activated.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 15/854,697, filed on Dec. 26, 2017 and entitled “MotionDetection Device and Motion Detection Method Thereof.” The disclosuresof the prior applications are incorporated herein by reference herein intheir entirety.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a smart motion detection device and arelated determining method, and more particularly, to a smart motiondetection device without losing images before wakeup of a processor anda related determining method.

2. Description of the Prior Art

Please refer to FIG. 1. FIG. 1 is a monitoring system 10 in prior art.The monitoring system 10 includes a passive detector 12 and an imagedetection device 14 electrically connected to an external host 16. Thepassive detector 12 can transmit a triggering signal to the externalhost 16 while detecting temperature variation, the external host 16wakes up by the triggering signal and then actuates the image detectiondevice 14, and the image detection device 14 executes an exposureadjustment while being actuated and starts to capture a monitoring imageor to record monitoring video. Thus, even though the passive detector 12detects the temperature variation, the image detection device 14captures the monitoring image at a later time in relation to atransmission period of the triggering signal, wakeup periods of theexternal host 16 and the image detection device 14, and an exposureadjustment period of the image detection device 14, so that themonitoring system 10 cannot record the monitoring video right after thepassive detector 12 detects an unusual state.

SUMMARY OF THE INVENTION

The present invention provides a smart motion detection device withoutlosing images before wakeup of a processor and a related determiningmethod for solving above drawbacks.

According to the claimed invention, a smart motion detection deviceincludes a memory, a processor having a sleep mode and a wakeup mode,and a sensor array directly coupled to the memory and furtherelectrically connected with the processor. An image captured by thesensor array is processed by the processor. The sensor array is adaptedto pre-store the image into the memory when the processor is operated inthe sleep mode, and the pre-stored image is received by the processor inthe wakeup mode. The sensor array includes a comparator adapted togenerate an alarm signal for switching the processor from the sleep modeto the wakeup mode in accordance with a comparison result of thepre-stored image.

According to the claimed invention, the smart motion detection devicefurther includes a passive sensor electrically connected with theprocessor and the sensor array, and adapted to output an alarm signalfor driving the sensor array to pre-store the image into the memory andswitching the processor from the sleep mode to the wakeup mode. Inaddition, the sensor array can include a comparator adapted to comparethe pre-stored image with a reference image, and the sensor arraypre-stores the image into the memory when intensity variation betweenthe pre-stored image and the reference image is greater than apredefined value.

According to the claimed invention, a smart motion detection device iscapable of receiving an alarm signal to monitor motion of an object. Thesmart motion detection device includes a sensor array, a memory and aprocessor. The sensor array is adapted to capture images at a first timeafter receiving with the alarm signal. The memory is directly coupled tothe sensor array and adapted to pre-store the captured images. Theprocessor is coupled to the sensor array and adapted to process thecaptured images through the memory at a second time after receiving withthe alarm signal. The second time is later than the first time.

According to the claimed invention, a determining method is applied to asmart motion detection device having a memory, a sensor array, and aprocessor coupled to the memory and the sensor array. The determiningmethod includes the processor analyzing images captured by the sensorarray when the sensor array is activated to capture the images, and theprocessor analyzing images pre-stored inside the memory when the sensorarray is not activated. The processor is enabled by an alarm signal.

According to the claimed invention, the smart motion detection deviceincludes a memory, a processor and a sensor array. The processor has asleep mode and a wakeup mode. The sensor array is directly coupled tothe memory and further electrically connected with the processor, and aplurality of images captured by the sensor array is processed by theprocessor. Images captured by the sensor array when the processor isoperated in the sleep mode are pre-stored into the memory, and imagescaptured by the sensor array when the processor is operated in thewakeup mode are transmitted to the processor.

According to the claimed invention, the smart motion detection deviceincludes a memory, a processor and a sensor array. The sensor array isdirectly coupled to the memory and further electrically connected withthe processor. The sensor array and the processor are turned off under anon-working mode. When the smart motion detection device receives atrigger signal, the sensor array directly captures and sends images tothe memory before the processor sends a request to the sensor array forreceiving the captured images.

The alarm signal may be generated by the sensor array or the passivesensor. The alarm signal is utilized to activate pre-storing operationof the sensor array and mode switching operation of the processor. Whenthe alarm signal is received, the sensor array can be activated tocapture the pre-stored image at a first time and the pre-stored image istransmitted to the memory. For waiting the duration of the processorswitched from the sleep mode to the wakeup mode, the processor whichreceives the alarm signal can send a request to the sensor array for thereal-time image and the pre-stored image at a second time later than thefirst time, so that the pre-stored image from the memory are processedlater than the first time, and the real-time image is not stored intothe memory but directly transmitted to the processor for the digitalprocessing. The smart motion detection device and the relateddetermining method of the present invention can effectively economizestart-up time of the smart motion detection device without waiting for awakeup period of the processor.

These and other objectives of the present invention will no doubt becomeobvious to those of ordinary skill in the art after reading thefollowing detailed description of the preferred embodiment that isillustrated in the various figures and drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a monitoring system in prior art.

FIG. 2 is a functional block diagram of a smart motion detection deviceaccording to a first embodiment of the present invention.

FIG. 3 is a procedural diagram of the smart motion detection deviceaccording to the first embodiment of the present invention.

FIG. 4 is a functional diagram of the smart motion detection deviceaccording to a second embodiment of the present invention.

FIG. 5 is a procedural diagram of the smart motion detection deviceaccording to the second embodiment of the present invention.

FIG. 6 is a functional diagram of the smart motion detection deviceaccording to a third embodiment of the present invention.

FIG. 7 is a procedural diagram of the smart motion detection deviceaccording to the third embodiment of the present invention.

FIG. 8 is a flow char of a determining method according to theembodiment of the present invention.

DETAILED DESCRIPTION

Please refer to FIG. 2 and FIG. 3. FIG. 2 is a functional block diagramof a smart motion detection device 20 according to a first embodiment ofthe present invention. FIG. 3 is a procedural diagram of the smartmotion detection device 20 according to the first embodiment of thepresent invention. The smart motion detection device 20 can include amemory 22, a processor 24 and a sensor array 26, which are threeseparate components or combined as one or two integrated components. Thesensor array 26 can be directly coupled to the memory 22 and furtherelectrically connected with the processor 24. The sensor array 26includes a plurality of light detecting pixels arranged in two-dimensionmanner to capture images. The processor 24 can be switched between asleep mode and a wakeup mode, and used to process an image captured bythe sensor array 26 to identify a particular event in the capturedimages, such as an unexpected object been captured in the capturedimages.

The image captured by the sensor array 26 may be pre-stored (i.e.,wrote) into the memory 22 or directly transmitted to the processor 24 inaccordance with modes of the processor 24 or an alarm signal resultedfrom motion detection. The memory 22 can have the image capacity ofpredefined quantity; when the memory 22 is full and a new image isprepared to pre-store, a former image can be removed for storing the newimage. The image processed by the processor 24 and the pre-stored imagein the memory 22 can be transmitted to an external storage module 28electrically connected with the smart motion detection device 20.

As the first embodiment shown in FIG. 3, the processor 24 stays in thesleep mode when the smart motion detection device 20 is not activated.The sensor array 26 can include a comparator 30 adapted to generate thealarm signal when monitoring motion of an object. As the processor 24 isoperated in the sleep mode, the sensor array 26 continuously orintermittently captures a plurality of images (such as capture fiveimages in every 1 second), and the plurality of images are pre-storedinto the memory 22; in the meantime, the comparator 30 reads andcompares at least some of the pre-stored images I1 with a referenceimage. When intensity variation between one of the pre-stored images I1and the reference image is smaller than a predefined value, theprocessor 24 keeps in the sleep mode and the comparator 30 reads thenext pre-stored image I1 for a comparison with the reference image. Whenthe intensity variation is greater than the predefined value, thecomparator 30 can generate the alarm signal utilized to awake theprocessor 24 and further to pre-store the image captured by the sensorarray 26 into the memory 22. That is, the alarm signal is used to switchthe processor 24 from the sleep mode to the wakeup mode.

There has variety ways for the comparator 30 to compare the pre-storedimages I1 and the reference image, for example the comparator 30 couldcompare whole image range or only compare partial pixels for thepre-stored images I1 and the reference image. The comparator 30 couldcompare intensity summation of all pixels or partial pixels, in anotherway the comparator 30 could compare intensity of each pixel in wholeimage range or only partial pixels.

When the processor 24 is operated in the wakeup mode, a real-time imageI2 captured by the sensor array 26 is directly transmitted to theprocessor 24 for digital processing and may not be stored into thememory 22. The processor 24 in the wakeup mode may process the real-timeimage I2 and receive the pre-stored image I1 in the memory 22 by turns,or may receive the pre-stored image I1 after processing of the real-timeimage I2. A process of the real-time image I2 can precede that of thepre-stored image I1, so the smart motion detection device 20 is able tofocus on an instant situation within the monitoring area. The process ofthe pre-stored image I1 may be executed when the process of thereal-time image I2 is completed or paused. If an operating capability ofthe processor 24 is sufficient for mass data, the real-time image I2 andthe pre-stored image I1 can be processed alternately, hence the smartmotion detection device 20 can show detection results about the currentand previous period at the same time.

In some embodiments, the pre-stored images captured by the sensor array26 when the processor 24 is operated in the sleep mode can be pre-storedinto the memory 22, and the real-time images captured by the sensorarray 26 when the processor 24 is operated in the wakeup mode can betransmitted to the processor 24. In other embodiments, the processor 24and the sensor array 26 can be turned off under a non-working mode; whenthe smart motion detection device 20 receives a trigger signal, thesensor array 26 can capture and send the images to the memory 22directly, and then the processor 24 can send a request to the sensorarray 26 for receiving the captured images. The trigger signal may be analarm resulted from an external unit or a built-in unit of the smartmotion detection device 20.

In addition, at least one of an image quality and a frame rate of thesensor array 26 may be changed when the processor 24 is operated in thesleep mode or the wakeup mode. For example, as the processor 24 is inthe sleep mode, the sensor array 26 can capture the low-quality image orcapture the image in the low frame rate for comparing with the referenceimage. Transmission bandwidth and storage capability are economizedaccordingly. The alarm signal is generated because the intensityvariation between the low-quality image (or the image captured in thelow frame rate) and the reference image is greater than the predefinedvalue, so that the sensor array 26 starts to capture the high-qualityimage or capture the image in the high frame rate for pre-storing intothe memory 22, and simultaneously the processor 24 can be switched tothe wakeup mode. Then, the pre-stored high-quality image or thepre-stored image captured in the high frame rate in the memory 22 istransmitted to the processor 24 operated in the wakeup mode; thereforethe smart motion detection device 20 does not lose image informationbefore the processor 24 is in the wakeup mode.

Please refer to FIG. 4 to FIG. 7. FIG. 4 is a functional diagram of thesmart motion detection device 20′ according to a second embodiment ofthe present invention. FIG. 5 is a procedural diagram of the smartmotion detection device 20′ according to the second embodiment of thepresent invention. FIG. 6 is a functional diagram of the smart motiondetection device 20″ according to a third embodiment of the presentinvention. FIG. 7 is a procedural diagram of the smart motion detectiondevice 20″ according to the third embodiment of the present invention.In the embodiments, elements having the same numerals as ones of thefirst embodiment have the same functions, and a detailed description isomitted herein for simplicity.

In a possible embodiment, the smart motion detection device 20′ caninclude the memory 22, the processor 24, the sensor array 26′ and apassive sensor 32. The passive sensor 32 is electrically connected withthe processor 24 and the sensor array 26′. The processor 24 is kept inthe sleep mode and the sensor array 26′ is shut down when the passivesensor 32 does not detect any abnormal situation. As the passive sensor32 detects the motion of the object, the passive sensor 32 can generatethe alarm signal, and the alarm signal is used to drive the sensor array26′ and switch the processor 24 from the sleep mode to the wakeup mode.When the processor 24 is still in the sleep mode, the sensor array 26′can capture and transmit the pre-stored image I1 to the memory 22. Whenthe processor 24 is operated in the wakeup mode, the sensor array 26′can capture and transmit the real-time image I2 to the processor 24, andthe pre-stored image I1 in the memory 22 can be transmitted to theprocessor 24 accordingly.

The smart motion detection device 20 may have the non-working mode. Theprocessor 24 and the sensor array 26′ can be turned off under thenon-working mode. As the passive sensor 32 detects the motion of theobject and generates the alarm signal, the sensor array 26′ is triggeredby the alarm signal and starts to capture and send the pre-stored imageinto the memory 22. After that, the processor 24 can be switched to thewakeup mode and then sends the request to the sensor array 26′ forreceiving the pre-stored image.

In another possible embodiment, the smart motion detection device 20″can include the memory 22, the processor 24, the sensor array 26″ havingthe comparator 30, and the passive sensor 32. The passive sensor 32 canactivate the sensor array 26″ when detecting the abnormal situation. Theactivated sensor array 26″ can capture and transmit the pre-stored imageI1 to the memory 22, and the comparator 30 can compare the pre-storedimage I1 with the reference image for determining whether to switch onthe processor 24. The comparator 30 is utilized to identify the abnormalsituation. If the intensity variation between the pre-stored image I1and the reference image is smaller than the predefined value, theabnormal situation may be resulted from noise and the processor 24 isnot switched on. If the intensity variation is greater than thepredefined value, the abnormal situation can be defined as someone orsomething intruding into the monitoring area of the smart motiondetection device, so that the processor 24 is switched to the wakeupmode for recording. As the processor 24 is operated in the wakeup mode,the real-time image I2 captured by the sensor array 26″ and thepre-stored image I1 in the memory 22 can be transmitted to the processor24 and then to the external storage module 28 for the digitalprocessing.

Please refer to FIG. 8. FIG. 8 is a flow char of a determining methodaccording to the embodiment of the present invention. The determiningmethod illustrated in FIG. 8 can be suitable for the smart motiondetection devices shown in FIG. 2 to FIG. 7. First, steps S800 and S802are executed to start the determining method and to monitor the motionof the object. The said monitoring function can be applied by the sensorarray 26, 26′ and 26″ or the passive sensor 32. As there is not abnormalsituation, step S804 is executed to keep the processor 24 in the sleepmode; as the motion of the object is detected, steps S806 and S808 areexecuted to generate the alarm signal for enabling the processor 24 andcapturing the image via the sensor array 26, 26′ and 26″. When theprocessor 24 is not operated in the wakeup mode, step S810 is executedthat the sensor array 26, 26′ or 26″ can produce the pre-stored image I1in the memory 22. When the processor 24 is operated in the wakeup mode,steps S812 and S814 are executed that the sensor array 26, 26′ or 26″can produce the real-time image I2, and both the pre-stored image I1 andthe real-time image I2 can be transmitted to the processor 24.

After that, step S816 is executed that the processor 24 can analyze thereal-time image I2 captured by the sensor array 26, 26′ or 26″ whencapturing function of the sensor array 26, 26′ or 26″ is activated. Whenthe sensor array 26, 26′ or 26″ is not activated, probably owning to thedisappeared object or any other situations, step S818 is executed toanalyze the pre-stored image I1 inside the memory 22 by the processor24. It should be mentioned that the processor 24 not only can processthe real-time image I2 before the pre-stored image I1, but alsoalternately process the pre-stored image I1 and real-time image I2 inaccordance with the user's actual demand and the sufficient operatingcapability.

In conclusion, the alarm signal may be generated by the sensor array orthe passive sensor (which can be a thermal sensor, an accelerometer or agyro). The alarm signal is utilized to activate pre-storing operation ofthe sensor array and mode switching operation of the processor. When thealarm signal is received, the sensor array can be activated to capturethe pre-stored image at a first time and the pre-stored image istransmitted to the memory. For waiting a duration of the processorswitched from the sleep mode to the wakeup mode, the processor whichreceives the alarm signal can send a request to the sensor array for thereal-time image and the pre-stored image at a second time later than thefirst time, so that the pre-stored image from the memory are processedlater than the first time, and the real-time image is not stored intothe memory but directly transmitted to the processor for the digitalprocessing. Comparing to the prior art, the smart motion detectiondevice and the related determining method of the present invention caneffectively economize start-up time of the smart motion detection devicewithout waiting for a wakeup period of the processor.

Those skilled in the art will readily observe that numerousmodifications and alterations of the device and method may be made whileretaining the teachings of the invention. Accordingly, the abovedisclosure should be construed as limited only by the metes and boundsof the appended claims.

What is claimed is:
 1. A smart motion detection device, comprising: amemory; a processor having a sleep mode and a wakeup mode; and a sensorarray directly coupled to the memory and further electrically connectedwith the processor, an image captured by the sensor array beingprocessed by the processor, the sensor array being adapted to pre-storethe image into the memory when the processor is operated in the sleepmode, and the pre-stored image being received by the processor in thewakeup mode.
 2. The smart motion detection device of claim 1, whereinthe sensor array comprises a comparator adapted to generate an alarmsignal for switching the processor from the sleep mode to the wakeupmode in accordance with a comparison result of the pre-stored image. 3.The smart motion detection device of claim 2, wherein the processor isawakened by the comparator when the comparator compares the pre-storedimage with a reference image and intensity variation between thepre-stored image and the reference image is greater than a predefinedvalue.
 4. The smart motion detection device of claim 1, wherein when theprocessor is operated in the wakeup mode, the image captured by thesensor array is directly transmitted to the processor.
 5. The smartmotion detection device of claim 1, wherein the image processed by theprocessor and the pre-stored image in the memory are transmitted to anexternal storage module electrically connected with the smart motiondetection device.
 6. The smart motion detection device of claim 1,wherein when the processor is operated in the wakeup mode, a real-timeimage captured by the sensor array is processed before a process of thepre-stored image.
 7. The smart motion detection device of claim 1,wherein when the processor is operated in the wakeup mode, thepre-stored image and a real-time image captured by the sensor array areprocessed alternately.
 8. The smart motion detection device of claim 1,wherein an image quality of the sensor array is changed when theprocessor is operated in the sleep mode or the wakeup mode.
 9. The smartmotion detection device of claim 1, wherein a frame rate the sensorarray is changed when the processor is operated in the sleep mode or thewakeup mode.
 10. The smart motion detection device of claim 1, furthercomprising: a passive sensor electrically connected with the processorand the sensor array, and adapted to output an alarm signal for drivingthe sensor array to pre-store the image into the memory and switchingthe processor from the sleep mode to the wakeup mode.
 11. The smartmotion detection device of claim 10, wherein the sensor array comprisesa comparator adapted to compare the pre-stored image with a referenceimage, the sensor array pre-stores the image into the memory whenintensity variation between the pre-stored image and the reference imageis greater than a predefined value.
 12. The smart motion detectiondevice of claim 10, wherein the alarm signal is utilized to activatepre-storing operation of the sensor array and mode switching operationof the processor simultaneously.
 13. The smart motion detection deviceof claim 10, wherein the passive sensor is a thermal sensor, anaccelerometer or a gyro.
 14. A smart motion detection device capable ofreceiving an alarm signal to monitor motion of an object, the smartmotion detection device comprising: a sensor array adapted to captureimages at a first time after receiving with the alarm signal; a memorydirectly coupled to the sensor array and adapted to pre-store thecaptured images; and a processor coupled to the sensor array and adaptedto process the captured images through the memory at a second time afterreceiving with the alarm signal; wherein the second time is later thanthe first time.
 15. The smart motion detection device of claim 14,wherein the captured images is pre-stored into the memory before beingprocessed by the processor.
 16. The smart motion detection device ofclaim 14, further comprising: a passive sensor electrically connectedwith the sensor array, and adapted to generate the alarm signal inaccordance with the motion of the object.
 17. The smart motion detectiondevice of claim 14, wherein the sensor array comprises a comparatoradapted to compare at least one of the captured images with a referenceimage, and to generate the alarm signal when intensity variation betweenthe at least one captured image and the reference image is greater thana predefined value.
 18. The smart motion detection device of claim 17,wherein the processor is switched from a sleep mode to a wakeup mode bythe alarm signal.
 19. A determining method applied to a smart motiondetection device having a memory, a sensor array, and a processorcoupled to the memory and the sensor array, the determining methodcomprising: the processor analyzing images captured by the sensor arraywhen the sensor array is activated to capture the images; and theprocessor analyzing images pre-stored inside the memory when the sensorarray is not activated; wherein the processor is enabled by an alarmsignal.
 20. The determining method of claim 19, wherein the sensor arraycomprises a comparator adapted to compare one of the images with areference image to generate the alarm signal.
 21. The determining methodof claim 19, wherein the smart motion detection device further has apassive sensor electrically connected with the processor and the sensorarray, and adapted to generate the alarm signal by monitoring motion ofan object.
 22. The determining method of claim 19, wherein the imagesare pre-stored into the memory by receiving the alarm signal before theprocessor is enabled, and the pre-stored images are analyzed after theimages captured in real-time are analyzed.
 23. A smart motion detectiondevice, comprising: a memory; a processor having a sleep mode and awakeup mode; and a sensor array directly coupled to the memory andfurther electrically connected with the processor, a plurality of imagescaptured by the sensor array being processed by the processor; whereinimages captured by the sensor array when the processor is operated inthe sleep mode are pre-stored into the memory, and images captured bythe sensor array when the processor is operated in the wakeup mode aretransmitted to the processor.
 24. A smart motion detection device,comprising: a memory; a processor; and a sensor array directly coupledto the memory and further electrically connected with the processor;wherein, under a non-working mode the sensor array and the processor areturned off, and when the smart motion detection device receives atrigger signal then the sensor array directly capturing and sendingimages to the memory before the processor sends a request to the sensorarray for receiving the captured images.